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(57) The present invention relates to a method for 
controlling a novel video game in which dancing is used 
as a factor in the behavior of a character, a machine for 
the video game, and a medium in which a program for 
the video game is recorded, and makes it possible to 
dance characters 61 1 and 612 displayed using 3-D pol- 
ygons in time with music, to evaluate their dance skills 
based mainly on whether dance actions are in time with 
the music, and to proceed with a story by winning 
matches with a computer or to match with other players. 
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Description 

Technical Field 

[0001] The present invention relates to methods for 5 
controlling video games designed so that a player deter- 
mines the behavior of a character on a video screen, in 
which the behavior itself, or effects caused by the 
behavior, or both, are displayed on the video screen so 
as to provide the player with a virtual experience, 10 
machines for the video games, am) media in which pro- 
grams for the games are recorded. 

Background Art 

15 

[0002] Conventional games of this type include: action 
games in which a character on a video screen over- 
comes obstacles and defeats opponent characters in 
order to reach a predetermined goal in accordance with 
commands input by a player operating a controller pro- 20 
vided with keys; fighting games in which, by making var- 
ious attacks, the life points (HP) of an opponent 
character operated by another player or by the compu- 
ter are reduced to zero so that the opponent character 
is defeated; adventure games in which any of the com- 25 
mands displayed on a screen is selected, and the story 
or ending varies in accordance with the selection; role- 
playing games in which field shifting, battle with oppo- 
nent characters, etc., are repeatedly performed, 
whereby a character is developed so that clearing an 30 
event is the goal; simulation games for measuring an 
ability of a player as an airplane pilot, a military com- 
mander, a head of a city, etc, or competing with another 
player or the computer; and various types of games in 
which the above factors are appropriately combined. 35 

Disclosure of Invention 

[0003] As described above, various types of video 
games have been proposed and realized. Currently, 40 
new video games are in continuing demand. 
[0004] It is an object of the present invention to pro- 
vide a method for controlling a video game in which 
dancing is introduced as a factor in the behavior of a 
character, a machine for the video game, and a medium 45 
in which the program of the video game is recorded. 
[0005] According to the present invention, in order that 
the foregoing object may be achieved, in a method for 
controlling a video game designed so that a player 
determines the behavior of a character on a video so 
screen, and the behavior itself, or effects caused by the 
behavior, or both are displayed on the video screen so 
as to be enjoyed as virtual experience of the player, a 
dance performed in time with music is used as a behav- 
ioral factor determined by said player, and an evaluation 55 
of the dance is presented to said player. 
[0006] Accordingly, the player can enjoy the dance of 
the character and the evaluation of it as the player's vir- 



tual experience. In addition, by controlling the progress 
of the game in accordance with the evaluation of the 
dance, the player can enjoy not only the dance but also 
other factors such as the progress of the story in an 
adventure game and the entrance of a hiding character. 
[0007] Here, by combining plural-type short dances 
(actions), which are executed when predetermined 
dance commands are input, to form the dance, various 
dances in accordance with operations by the player can 
be performed by the character. 

[0008] It is basically appropriate to evaluate the dance 
based on whether dance command inputting is in time 
with the rhythm of music. When command inputting 
fails, or no command inputting is performed for a prede- 
termined interval or more, the character flashes. When 
the inputting of a command having a high level of diffi- 
culty succeeds, successive actions succeed, a compos- 
ite action is performed, no failure in command inputting 
is detected for not less than predetermined time, and 
the connection between actions is preferable, an addi- 
tional score is given, whereby interest as to operating 
can be enhanced. 

[0009] In addition, by using music recorded on an ordi- 
nary music CD as dance music, the character can be 
danced in time with music of the player's preference, 
and dance scenes are edited to form video clips. 

Brief Description of the Drawings 

[0010] 

Fig. 1 is an outline view showing a video game 
machine for realizing a video game according to the 
present invention; Fig. 2 is an internal block dia- 
gram showing a game machine; Fig. 3 is a view 
showing one example of a controller; Fig. 4 is a 
flowchart of screen transitions showing the flow of a 
game system according to the present invention; 
Fig. 5 is a flowchart of screen transitions showing 
the flow of the Story Mode in a game system 
according to the present invention; Fig. 6 is a draw- 
ing showing one example of a field screen; Fig. 7 is 
a drawing showing one example of an event screen; 
Fig. 8 is a drawing showing one example of an item 
screen; Fig. 9 is a drawing showing one example of 
a passport screen; Fig. 10 is a drawing showing 
one example of a parameter screen; Fig. 11 is a 
drawing showing one example of a memory screen; 
Fig. 12 is a drawing showing one example of a com- 
mand list screen; Fig. 13 is a drawing showing one 
example of a charge list screen; Fig. 14 is a drawing 
showing one example of a screen in the Dancing 
Part; Fig. 15 is a table showing specific dance com- 
mands; Fig. 16 consists of drawings showing spe- 
cific actions; Fig. 17 is a flowchart showing the 
program of the Dancing Part; Fig. 18 is a configura- 
tion chart showing data used for determining the 
matching of dance commands; Fig. 19 is a detailed 
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% flowchart showing scoring; Fig. 20 is a view show- 

ing one example of a winning screen in the Dancing 
Part; Fig. 21 is a view showing one example of a 
defeat screen in the Dancing Part; Fig. 22 is a flow- 
chart of screen transitions showing the flow of the 
Free-Dance Mode in a game system according to 
the present invention; Fig. 23 is a drawing showing 
one example of a menu screen in the Free-Dance 
Mode; Fig. 24 is a drawing showing one example of 
a character selecting screen; Fig. 25 is a drawing 
showing one example of a command list screen; 
Fig. 26 is a flowchart showing the flow of a program 
for analyzing rhythm from a music CD; Fig. 27 is a 
drawing showing one example of a change in the 
level of sound of music in a music CD; Fig. 28 is a 
drawing showing one example of an editing screen 
in the Movie Studio; Fig. 29 is a drawing showing 
one example of a menu screen in the Config Mode; 
Fig. 30 is a drawing showing one example of a 
game character; Fig. 31 is a drawing showing one 
example of a game character; Fig. 32 is a drawing 
showing one example of a game character; Fig. 33 
is a drawing showing one example of a game char- 
acter; Fig. 34 is a flowchart of another program for 
analyzing rhythms of the music CD; Fig. 35 is a 
drawing showing another example of level changes 
of music in the music CD; Fig. 36 is a flowchart of a 
program for specifying, based on an input from the 
player, the start of a measure of music; Fig. 37 is a 
flowchart of a program for interpolating dance 
motions in time with rhythms, Fig. 38 is a block dia- 
gram of the control system of a vibrator; and Fig. 39 
consists of flowcharts (a), (b) and (c) showing pro- 
grams for the control system of the vibrator. 

Best Mode for Carrying Out the Invention 

[0011] Fig. 1 shows a video game system for realizing 
a video game according to the present invention, and 
particularly shows an outline of a home video game sys- 
tem. Fig. 1 shows a game machine 1 ; a controller 2 for 
inputting various commands, which is connected to the 
game machine 1; a monitor 3 such as a television for 
outputting a game screen and music, which is con- 
nected to the game machine 1; an external storage 
device 4 for storing saved game data, etc., which is set 
in the game machine 1, or a memory card (as is the 
case here); and a medium 5 recording a game program 
executable by the game machine 1, or a CD-ROM (as is 
the case here). 

[0012] The CD-ROM 5 is loaded into a CD-ROM drive 
(not shown) having a loading flip-up cover 101 on the 
top surface of the game machine 1 1 and its game pro- 
gram and data are read. The game machine 1 includes: 
a power-supply switch 102; a reset switch 103; and a 
flip-up button 104 for the flip-up cover 101. 
[0013] Fig. 2 shows the detailed internal circuit struc- 
ture of the game machine 1. The game machine 1 
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includes: a central processing unit (CPU) 111; an 
image-data generating processor (GTE) 112 directly 
connected to the CPU 1 1 1 ; a system controller 114 con- 
nected to the CPU 111 via a main bus 113; a main 

5 memory 115; a system ROM 116; an image-data 
decompression decoder (MDEC) 117; a parallel inter- 
face (I/O) 1 18; an image processor (GPU) 120; a sound 
processor (SPU) 121; a CD-ROM decoder 122; a com- 
munication interface 123; a frame buffer 124 connected 

10 to the image processor 120; a sound buffer 125 con- 
nected to the sound processor 121; and a CD-ROM 
driver 1 26 and a CD-ROM buffer 127 that are connected 
to the CD-ROM decoder 122. 

[0014] The image-data generating processor 112 car- 
15 ries out large-scale data operations such as coordinate 
transformation and ray tracing computation, based on 
instructions from the CPU 111. The system controller 
114 performs interruption control, memory access con- 
trol, etc. The system ROM 116 stores a basic program, 
20 etc. The image-data decompression decoder 117 
decodes image data compressed and encoded based 
on the MPEG or JPEG, etc. 

[0015] In accordance with an instruction from the CPU 
1 1 1 , the image processor 120 uses the frame buffer 124 

25 to generate game-screen video signals, and outputs 
them to a monitor 3. In accordance with an instruction 
from the CPU 111, the sound processor 121 uses the 
sound buffer 125 to generate sound signals including 
background music and background sounds, and out- 

30 puts them to the monitor 3 (or another audio system, 
etc.). 

[0016] The CD-ROM decoder 122 reads through the 
CD-ROM drive 126 programs and data recorded in the 
form of error-corrected codes on the CD-ROM 5, and 

*5 stores them once in the CD-ROM buffer 127. It then 
decodes them into the original programs and data. 
[0017] The communication interface 123 exchanges 
various signals and data with the controller 2 and the 
memory card 4. 

40 [0018] Fig. 3 shows one example of the controller 2. 
Operation keys 201 to 214 are used to input various 
commands. The keys 201 to 204 are used as left, right, 
upper, and lower direction keys to move a character and 
to select an item from a menu. The key 205 is used as a 

45 determination button, the key 206 is used as a cancel 
button, the key 207 is used as a menu-display button, 
and the key 209 is used as a start/pause button except 
when they are used in the Dancing Part described 
below. In the Dancing Part, the keys 201 to 208 are 

50 used to input dance commands, and the keys 21 1 and 
213 are used as camera-perspective-changing keys. (In 
this game, the keys 210, 212, and 214, are not used.) 
[0019] Fig. 4 shows the flow of events in a game sys- 
tem according to the present invention, using transitions 

55 of a screen. 

[0020] When the CD-ROM 5 with the game program 
recorded thereon is set in the game machine 1, and the 
power-supply switch 102 is turned on (s1), an initial 
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\ screen (maker logotype indication) is displayed (s2), 

and the memory card 4 is checked (s3) before a title 
screen is displayed (s4). In the memory card checking, 
information about characters and actions capable of 
being used in the Free Dance Mode described below is 
loaded. 

[0021] A menu for selecting the "Story Mode", the 
"Free dance mode", or the "Config Mode" is displayed 
on the title screen, on which, by operating the direction 
keys 201 to 204 of the controller 2 so as to select any 
one mode, and operating the determination button, 
transfer to the selected mode is performed (s5, s6, and 
s7). In the case where no operation is performed for a 
given interval (e.g., 15 seconds) while the title screen is 
being displayed, an opening demonstration may auto- 
matically be started (S8) (Return to the title screen is 
performed by the end of the demonstration or the oper- 
ation of the start button, etc.). 

[0022] The "Story Mode" is such that a player manip- 
ulates one leading character (for example, a girl) to have 
dance matches with rival characters throughout the 
world, and this mode is broadly divided into two parts: 
the "Adventure Part", and the "Dancing Part". In the 
Adventure Part, in accordance with a story, moving in 
fields, experiencing various events, and searching for 
commands to be used in the Dancing Part, are per- 
formed. The Dancing Part corresponds to an event in 
the Adventure Part, in which the leading character has 
dance matches with many rival characters, and masters 
a new dance by dancing with a character to become an 
instructor. 

[0023] Referring to the Adventure Part for more 
details, for example, the leading character practices and 
masters a first dance in a home city in Japan, and then 
has dance matches with rival characters throughout 
Japan. Winning the matches allows the leading charac- 
ter to go to cities in countries around the world. The cit- 
ies have dances representing the countries. 
Accordingly, the leading character has dance matches 
with rival characters who are masters of the dances, 
and if she defeats all the rival characters, the story ends. 
In each city, there is a character to become an instructor 
who teaches a dance representing each country. The 
leading character is allowed to use the dance if the 
instructor instructed her in the dance, and "passed" her. 
A dance, performed by the leading character in a match 
with a rival character, does not need to be a dance for 
each city, but any one of the dances that have been 
mastered (can be danced) may be performed. 
[0024] The "Free Dance Mode" is designed so that the 
Dancing Part in the "Story Mode" can be enjoyed as a 
pure action game under various rules. This mode 
includes: the "Free Mode" (corresponding to matches 
with rival characters in the Story Mode) in which one 
freely combines dances by oneself to aim for high 
scores; and the "Trace Mode" (corresponding to 
matches with characters to become instructors in the 
Story Mode). Each mode further has three play modes: 
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the "1 PLAY MODE", the "VS COM MODE (versus-com- 
puter battle)", and the "2 PLAY MODE (battle against 
another player)". In addition, dancing in time with com- 
mercial CD music, and the making of video clips by sav- 
5 ing one's dance in the memory card, are possible. 

[0025] The "Config Mode" performs various setting 
such as data loading, and sound switching 
(stereo/monophony). 

[0026] Fig. 5 shows the flow of events in a game sys- 
10 tern according to the present invention using screen 
transitions. 

[0027] When the Story Mode is selected, it is neces- 
sary that starting a new game (NEW GAME), or using 
saved data to start a game from an intermediate stage 

15 (CONTINUE) selected by using an operation similar to 
that described above. Selecting the starting of a new 
game displays a setting screen (name-input screen), 
while selecting the starting from an intermediate stage 
displays a loading screen (s1 1, s12). By inputting on the 

20 setting screen the name of a leading character before 
determining it, or selecting any one of ordinarily plural 
saved data before determining (loading) it, transfer to 
the first field screen or a field screen (shifting screen) 
obtained at the point of saving is performed (s13), and 

25 the Adventure Part starts. 

[0028] A player (leading) character has the following 
parameters. In the Story Mode, the NEW GAME case 
sets default values (initial values) as the parameters, 
and the CONTINUE case sets values of the saved data 

30 as the parameters. Money: represents one's own 
money. The units are in dollars ($), and the value range 
is 0 to 65535. 

Physical Strength: represents endurance. The 
35 value range is 0 to 255. 

Instantaneous Power: represents swiftness. The 
value range is 0 to 255. 

Willpower: affects the condition of dancing. The 
value range is 0 to 255. 
40 Luck: affects random factors in the game and the 
condition of dancing. The value range is -128 to 
127. 

[0029] Fig. 6 shows one example of a field screen, 
45 which includes a street 601 and a character 602 that are 
ordinarily displayed using two-dimensional (2-D) graph- 
ics. Operating the direction keys 201 to 204 allows the 
player character to move in eight directions (including 
four diagonal directions obtained when two adjacent 
so direction keys are simultaneously pressed). The player 
character can meet and converse with a person walking 
in the Street (s14), and can inspect a suspicious place, 
or can enter the inside of a building 603 (s15). 
[0030] At this time, the entrance of the player charac- 
55 ter into a specific building, or the player's conversation 
with a specific person, performs transfer to an event 
screen, namely, a screen on which the player character 
fights with a rival character or a character who may be 
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an instructor (s16). 

[0031] Fig. 7 shows one example of an event screen, 
'on which a close-up view of the player character and the 
opponent character is displayed, and it is transferred to 
the Dancing Part automatically or by the contents of 5 
conversation (s17). In the Dancing Part, winning by the 
leading character displays a winning screen (s18), and 
defeat of the leading character displays a defeat screen 
(s1 9), which details are described below. In the case of 
the defeat, the leading character can have a match 10 
again (s20). 

[0032] If the building is a shop, transfer to a shop 
screen can be performed (s21), and if the building is a 
save point, transfer to a save screen can be performed 
(s22). 15 
[0033] By operating a menu-display button on the field 
screen, a menu of two commands: the "Item Command" 
and the "Passport Command" can be called up (s23). 
By using an operation similar to that described above to 
select and determine either command of the menu, 20 
each screen theretor is displayed (s24 or s25) 
[0034] Fig. 8 is one example of an item-display 
screen, on which items that are purchased at a shop, 
obtained by winning an event, and picked up on a road- 
side are displayed. Accordingly, selected items can be 25 
put on, taken off, thrown away, and so forth. 
[0035] Fig. 9 is one example of the passport screen. 
The passport has four headings: the "Parameters", the 
"Memories", the "Commands", and the "List of 
Charges". By selecting and determining any one of 30 
them in a manner to the above-described operation, a 
screen showing details in each heading is displayed. 
Specifically, selecting the "Parameter" displays a facial 
photograph and a profile of the leading character, and 
the above-described parameters, as shown in Fig. 10. 35 
Selecting the "Memories" displays facial photographs 
and profiles, etc., of rival characters with which the lead- 
ing character has had matches, as shown in Fig. 10. 
Selecting the "Commands" dispjays a list of dance com- 
mands capable of being used at present, as shown in 40 
Fig. 12. Selecting the "List of Charges" displays a list of 
charges needed for moving around countries of the 
world, as shown in Fig. 13. 

[0036] By operating the determination button at a 
point in front of a bus stop on the field screen, the lead- 45 
ing character can get on a bus and can move to an air- 
port (transfer to an airport screen) (s26). On the airport 
screen, a menu of three commands: the "Travel Com- 
mand", the "Passport Command", and the "Move Com- 
mand (returning to the street)", is displayed. so 
[0037] Here, the use of operation similar to that 
described above to select and determine the Travel 
Command (s27) performs transfer to a world-map 
screen on which the present location of the leading 
character and cities to which the leading character can 55 
move are displayed (s28). Selecting and determining 
the city to which the leading character moves (s29) per- 
forms transfer to a field screen of the destination via a 



move-by-air screen. Selecting and determining the 
Passport Command (s30) displays the above-described 
passport screen (s31). By selecting and determining the 
move command (s32), return to the field screen of the 
present location is performed. By performing cancella- 
tion after the transferring to the world-map screen (s33), 
return to the field screen of the present location can be 
performed. 

[0038] Next, the Dancing Part is described. 
[0039] The Dancing Part causes the player (leading) 
character, who is displayed using three-dimensional (3- 
D) graphics, to dance in time with music, and deter- 
mines the issue by evaluating this dance and the dance 
of the opponent character, who is operated by the com- 
puter (CPU), based on predetermined standards. The 
dance is a combination of types of short dances 
(actions), and one action is executed when a predeter- 
mined dance command is input. Dance-command 
inputting can be performed by operating the same keys 
or different keys twice or more times in predetermined 
order; simultaneously operating keys of at least two 
types; operating the same key for a given interval or 
more, or arbitrarily combining these operations. 
[0040] Fig. 14 shows one example of a screen in the 
Dancing Part, which displays: leading and opponent 
characters 611 and 612, the names of the characters 
613 and 614, remaining time until music ends 615, the 
types of dances 616 and 617 to which the characters 
are dancing, a stage name (country name) 618, and 
condition meters 619 and 620 (expressed by faces 
beside the names here) indicating the character condi- 
tions. In the case where the opponent is a character to 
become an instructor, a next-command display window 
composed of a dance command to be input next and the 
dance name is displayed on a lower portion of the 
screen. 

[0041] Fig. 15 shows specific dance commands and 
the action names thereof. In the commands, "<-", 
"T", "i", " O ". " A "* and Ma "» mean the operating of 
the keys 201, 202, 203, 204, 205, 206, 207, and 208, 
respectively. In Fig. 16, (a), (b), (c), and (d), by way of 
example, four specific actions are shown. 
[0042] In this game, when commands are continu- 
ously input, in other words, the next command is input 
before the action by the previously input dance com- 
mand ends, the character will proceed to the next 
action. In this processing, in the case where an input 
interval is extremely short, or there is something wrong 
with the connection between the present action and the 
next action (e.g., the character does a handstand in the 
middle of jumping, etc.), the next action is not executed, 
which is regarded as a failure, and the present action 
ends. Conversely, in the case where the connection 
between the present connection and the next connec- 
tion is good (e.g., the character rotates the body while 
jumping), a composite action may be performed. The 
character is basically not moved by command inputting, 
but its position may be moved as a result of an action. 
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% [0043] Fig. 17 shows the flow of the program in the 

Dancing Part. The flow is described below. 
[00*44] At first, the present condition of the character is 
acquired (s41). The present condition of the character 
represents the condition meter (character condition) at 
the point of time, and an action being performed by the 
character. It influences the feasibility of the next action. 
[0045] In the condition meter, a highest condition and 
a lowest condition are expressed as relative values 1 00 
and 1 , respectively. There is a dance command that can 
be used only when the value is the highest. The possi- 
bility that an action fails is influenced by the difference 
between the condition meters of the player character 
and the opponent character. The condition meter is 
incremented when a big action (action difficult to be 
input) is determined, or no input errors are detected for 
a predetermined period, while it is decremented when 
an action fails, no action is performed for a predeter- 
mined period, or the opponent character determines a 
big action. 

[0046] Next, it is determined which manipulates the 
character, the player or the CPU (s42). If the CPU 
manipulates the character, it determines the next action 
(thought) of the character in accordance with predeter- 
mined rules (s43). If the player manipulates the charac- 
ter, key operation using the controller 2 is saved (s44), 
and it is determined whether contents in the key buffer 
matches a dance command (s45). 
[0047] Fig. 18 shows the structure of data used for 
matching determination, which is a hierarchical tree 
structure having a number of trees corresponding to the 
number of keys used for inputting dance commands, 
namely, "8". The tree structure is traced in the order of 
key inputs saved in the key buffer, whereby it is deter- 
mined whether or not there is a dance command match- 
ing contents in the key buffer. At this time, there is no 
dance command, it is determined that command input- 
ting has failed. In addition, if an action branches below 
data representing the final key, it is determined that the 
dance command for the action has been input. In the 
example shown in Fig. 18, the input "T" and the input "T 
• T • X" represent dance commands for the actions 
termed "jump" and "leap", respectively. 
[0048] In the case where command inputting does not 
fail in the above-described command determination, the 
next motion is determined based on the relationship 
with the above-described character condition (s46). 
Specifically, in the middle of inputting a dance com- 
mand, a motion in accordance with the previous dance 
command is set. In the case where command inputting 
is established, if there is no particular problem in con- 
nection and interval with the present action, an action is 
set which corresponds to an input command. If the con- 
nection is particularly good, a composite action is set as 
described above. Conversely, if the interval is short, or 
the connection is bad, it is regarded that command 
inputting has failed, which sets a failure action. In the 
case of the failure action, reactions such as "tumbling" 



and 'tailing" are performed based on the value of the 
condition meter. In the case of the CPU-manipulated 
character, a motion is similarly determined. 
[0049] The determination of the motion performs tim- 

5 ing acquiring for extracting the present condition of 
music (s47). Actually extracted data is the information 
"How many frames are there from the present point in 
time to the next beat (accent in the rhythm of music)?". 
The "frame" means one image frame, and this game 

w operates using 1/30 of a second for one frame. 

[0050] Scoring is subsequently performed. The scor- 
ing increases or reduces the score so as to correspond 
to the motion of the character for each frame (s48). In 
Fig. 19, the flow of a detailed program for the scoring is 

15 shown. 

[0051] Specifically, it is determined whether there is a 
key input (s481). If there is a key input, and the com- 
mand inputting is established in the above-described 
command determination (s482), a shift between the tim- 

20 ing of the command establishment (last key input in 
command), and timing information obtained in the 
above-described timing acquiring, namely, a music 
beat, is computed, and the score is increased or 
reduced based on the magnitude of the shift (In detail, 

25 the difference between a frame in which the command 
is established, and a frame having the next beat, is 
found, and the score is further increased as the differ- 
ence decreases, namely, the degree of matching the 
music beat is higher, while the score is further reduced 

30 when the difference is Iarger)(s483). 

[0052] In the case where there is a key input and a 
command is not established, it is further determined 
whether command inputting has failed (s484). If com- 
mand inputting has failed, the score is reduced based 

35 on the degree of the failure (s485). If it is not regarded 
that command inputting has failed, the process ends 
being regarded as having been in the middle of input- 
ting. In the case where no key input is received for a 
given interval or more, the score is reduced (s486). 

40 [0053] In addition, in the case where a highly difficult 
command is input; successive actions are performed; a 
composite action is performed; no command is input for 
not less than predetermined time; or the connection 
(construction and balance) between actions is good, a 

45 bonus is added to the scored (s487). 

[0054] When the scoring ends, effect processing in 
screen display corresponding to the above-described 
character motion, namely, the motion of hair and cloth- 
ing, the position of a camera or light, sound effects, etc., 

so are processed (s49). 

[0055] When the above-described processes end for 
all the characters (s50), screen displaying (including 
sound processing) is performed (s51). Moreover, the 
foregoing processes are repeatedly performed until the 

55 music ends (s52), whereby, based on the score of each 
character counted in this game, the issue is determined, 
and the result is displayed on the screen (s53) before 
the scoring ends. One example of a winning screen is 
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\ displayed in Fig. 20, and one example of a defeat 

screen is displayed in Fig. 21. 

t0 056] The Dancing Part is influenced by the above- 
described parameters (excluding the money). Specifi- 
cally, the Physical Strength influences the incrementing 
or decrementing of the condition meter. As this value is 
greater, the condition meter is less decremented. The 
Instantaneous Power influences the continuous input- 
ting of commands. As this value is greater, the continu- 
ous inputting is accepted more easily. The Willpower 
influences reactions performed when command input- 
ting fails. As this value is greater, the possibility of tum- 
bling is lower. The Luck influences the incrementing or 
decrementing of the condition meter. As this value 
increases, the condition meter is further incremented. In 
addition, in the Dancing Part, by operating the keys 21 1 
and 21 3 of the controller 2, the position of a viewpoint 
(camera) can be arbitrarily changed. 
[0057] Fig. 22 shows the flow of the Free-Dance Mode 
of the game system according to the present invention 
using screen transitions. 

[0058] Selecting the Free-Dance Mode displays a 
menu screen as shown in Fig. 23 (s61). On the menu 
screen, the selection items: "MODE SELECT", "CHAR- 
ACTER (CHARA)", "STAGE", "TIME", "SOUND", 
"LEVEL", "COMMAND", "MOVIE STUDIO", and 
"START", are vertically arranged in the center. Among 
them, a selected item ("START" by default) flashes. 
[0059] By operating the upper and lower direction 
keys 203 and 204, the selected item can be changed. 
With an item selected, by operating the left and right 
direction keys 201 and 202, the contents can be 
changed. Also, by operating the determination button 
205, with some item selected, the next screen is dis- 
played. 

[0060] When "MODE SELECT' on the menu screen 
(s62) is selected, ways of playing in the Free-Dance 
Mode can be selected. Specifically, as described above, 
among the following six: "1 PLAY MODE", "VS COM 
MODE", and "2 PLAY MODE" of the "Trace Mode", and 
"1 PLAY MODE", "VS COM MODE", and "2 PLAY 
MODE" in the "Trace Mode", one item is selected. 
[0061] Selecting "CHARA" (s63) performs transfer to 
a character selecting screen as shown in Fig. 24 (s64), 
in which player and opponent characters can be 
selected. Specifically, selection windows for one player 
and two players are displayed on the right and left sides 
of the screen, and the faces of characters that can be 
selected are vertically arranged in windows 631 and 
632 positioned to the center of the screen. Faces are 
selected using the upper and lower direction keys 203 
and 204 as described above, and are determined using 
the key 205 (can be canceled using the key 206). At this 
time, the name of the selected character and the 
selected type of dance are displayed in upper wide win- 
dows 633 and 634, and 2-D graphics images are dis- 
played in tall windows 635 and 636. With the character 
selected, by moving a cursor to the windows 635 and 
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635, and operating the left and right direction keys 201 
and 202, the costume of the character can also be 
changed. Moreover, in the case where the character 
was defeated in the Story Mode, the character can be 

5 changed to the leading character (The selected dance 
can be done by the leading character). The above- 
described selecting is performed as follows: 
In the "1 PLAY MODE", a player can select with a one- 
player controller a character to be manipulated by the 

io player and a character to be manipulated by the CPU, 
whereas in the "2 PLAY MODE", players can select with 
their controllers, characters to be operated by the play- 
ers. 

[0062] When "STAGE" is selected (s65), which stage 

15 (country) where fighting should be performed can be 
selected. Specifically, nine stages used in the Story 
Mode (plus hiding stages) or "RANDOM" can be 
selected. Selecting "TIME" (s66) sets a time limit for 
dance. Specifically, one can be selected from three lim- 

20 its: 30 seconds, 120 seconds, and "END OF SONG". 
[0063] When "SOUND" is selected (s67), music to be 
used as background music can be selected using its 
number. In addition to the music number, there is an 
item entitled "CD CHANGE". By selecting this item, in 

25 the case (described below) where music recorded on a 
commercial music CD is used as dance music, timing 
for switching from the CD-ROM 5 is displayed on the 
screen so that the player will be aware of it. When 
"LEVEL" is selected (s68), the level of difficulty in game 

30 can be set. The level of difficulty influences the strength 
of the CPU-manipulated character, and can be selected 
from the following three: "EASY", "NORMAL", and 
"HARD". 

[0064] Selecting "COMMAND" (s69) displays a list of 
35 commands for the dance of the selected character as 
shown in Fig. 25 (s70) (in the case of "2 PLAY MODE" 
here). Concerning the hiding commands, only those 
detected in the Story Mode are displayed. In the case 
that one screen is insufficient for displaying, scroll dis- 
40 play is performed by operating the upper and lower 
direction keys 203 and 204. 

[0065] Selecting "START" (s7 1 ) performs transfer to a 
Dancing Part (s72). This Dancing Part is the same as 
that in the Story Mode described above (Default param- 
45 eters for each character are used). After the dance 
ends, return to the menu screen is performed via a 
dance evaluation screen (s73) (Also a winning or defeat 
screen is included in "2 PLAY MODE" and 'VS COM 
MODE"). 

so [0066] In the Dancing Part in the Free-Dance Mode, 
dancing can be performed in time with arbitrary music of 
the player's preference, which is recorded on a commer- 
cial music CD, etc. 

[0067] In the menu screen in Fig. 23, by selecting 
55 "SOUND", and also selecting "CD CHANGE", a mes- 
sage for instructing the player to change CD is displayed 
on the screen. Exchanging the CD-ROM 5 and the 
music CD displays a music number in the music CD. 
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v When the music to be played is determined by operating 

the left and right direction keys 201 and 202, and the 
determination button 205, return to the menu screen in 
Fig. 23 is performed. Selecting "START" in this condition 
performs transfer to the Dancing Part, similarly to the 
case where the internally stored music is used. (When 
the music CD is identified as a predetermined, particu- 
lar music CD by performing ID checking on the music 
CD, a special hidden character may be set to be usable) 
[0068] At this time, internally, the data of the music CD 
are analyzed during an introduction of the start of music 
to the start of dancing, whereby rhythm extracting is pre- 
pared. After the dance starts, whether the rhythm 
extracted from the music CD matches the timing of com- 
mand inputting by the player is evaluated so that it is 
reflected in the score. 

[0069] In Fig. 26, the flow of a program for analyzing 
the rhythm from the music CD is shown. By performing 
computation in which the data (PCM 44.1 kHz/16 
bits/stereo) obtained from the music CD (s91) is multi- 
plied by 256 bytes to form 1 sample, the magnitude of 
bass components is extracted and recorded (s92). This 
computation is performed every 1/60 of a second (1 
Vsync) in order to output the Vsync interval at which the 
music beat is generated, and pre-sampling at 256/60 ( 
4.3 seconds is performed for computing the rhythm from 
statistics of 256 samples (s93 and s94). In Fig. 27, one 
example of level change of music in the music CD is 
shown. 

[0070] Selecting "MOVIE STUDIO" (s74) performs 
transfer to a movie studio. In the movie studio, the 
dance in the Dancing Part played just before the movie 
studio, or a dance that was saved in the movie studio 
and that was loaded when transfer to the movie studio, 
can be replayed. It can be edited to create an original 
video clip. What can be edited are the following three: 
camera perspective position, light adjustment (position 
and intensity); and effects (spotlight, etc.). 
[0071] In the case where transfer to the movie studio 
has been performed, a loading screen for the movie stu- 
dio is displayed (s75). The loading screen has the alter- 
native of loading or not loading, and a plurality of saved 
data. By using an operation similar to that described 
above to select and determine whether to perform load- 
ing, or to select and determine saved data to be loaded, 
transfer to the menu screen for the movie studio is per- 
formed (s76). 

[0072] The menu screen for the movie studio has 
"PLAY", "EDIT", and "EXIT" as options. By operating the 
upper and lower direction keys 203 and 204, and the 
determination button 205 before selecting the "PLAY" 
(s77), transfer to the proximate screen or the loaded 
replay screen in the Dancing Part is performed (s78). 
Also, selecting "EDIT" (s79) performs transfer to an edit- 
ing screen in the Dancing Part as shown in Fig. 28 
(s80), and selecting "EXIT" (s81) performs return to the 
menu screen in Fig. 23. 

[0073] Fig. 28 shows one example of the editing 



screen displaying: a dancing character 641 to be edifed, 
key assigned indications 642 indicating how to use con- 
troller keys, an operation panel 643 on which buttons for 
reproducing and halting the dance are arranged, an 

5 information window 644 for displaying various informa- 
tion; and a time 645. Actual editing is performed such 
that, while the dance is being reproduced, the camera 
perspective position is changed, the light is adjusted, 
and the effects are applied in controller operation. The 

10 editing can be performed for each frame, and can be 
repeatedly retried. In the case where data are not 
loaded and the previous Dancing Part was performed in 
"2 PLAY MODE", a message for asking which dance 
should be edited, for one player or two players, is dis- 

75 played before editing. 

[0074] When the dance ends and editing is finished, 
transfer to the save screen for the movie studio is per- 
formed (s82). The save screen has: the alternative of 
saving or not saving, and a plurality of saved data files 

20 the same as on the loading screen. By selecting and 
determining "not saving", or selecting and determining a 
save data file to be saved, return to the menu screen in 
Fig. 23 is performed. When saving is performed, an 
action sequence, a change in the camera perspective 

25 position, a change in the light, and timing of the effects, 
are stored in the save data file. 

[0075] in the title screen of this game system, select- 
ing "CONFIG MODE" displays a menu screen in the 
mode as shown in Fig. 29. On the menu screen, selec- 
30 tion items: "LOAD", "RANKING RESET', "WINDOW 
COLOR", "SOUND", and "EXIT" are vertically arranged 
in the center of the screen, and among them, a selected 
item ("EXIT" by default) blinks. 

[0076] The selected item can be changed by operat- 
es ing the uppor and lower direction keys 203 and 204. 
With an item of a sub-item selected, by operating the left 
and right direction keys 201 and 202, its contents can 
be changed. Concerning another item, by operating the 
determination button 205, a message representing exe- 
40 cution confirmation is displayed, and by operating the 
determination button 205, the item is executed. 
[0077] Selecting "LOAD" on the menu screen can load 
basic data (characters capable of being used, com- 
mands, etc.). Normally, the basic data are automatically 
45 read when the game is activated. However, they are 
used when they need to be read again due to exchange 
of memory cards. Selecting "RANKING RESET" can 
delete various types of ranking data displayed in the title 
demonstration. Selecting "WINDOW COLOR" can 
so change the colors (e.g., any of preset eight colors) of a 
window, fonts, etc., to be used in the game. Selecting 
"SOUND" can switch a sound output to "STEREO" or 
"MONAURAL". Selecting "EXIT" performs return to the 
title screen. 

55 [0078] In Fig. 30 to Fig. 33, examples of game charac- 
ters used in the present invention are shown. 
[0079] Fig. 34 shows the flow of another program for 
performing rhythm analysis when a music CD is used 
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v for game background music. 

[0080] In this program, 256 sample of waveform data, 
as a sound output with the playback of the music CD, 
are extracted every 1/60 seconds (s101), and these are 
used as original data to perform computation and esti- 5 
mation. In other words, by performing pseudo-down- 
sampling on the extracted waveform data (s102), the 
data are processed to be a waveform in which bass 
components are enhanced. From the processed wave- 
form data, peak values are obtained (computed) (s1 03). w 
The peak values are always stored for the latest 256 
sample (s1 04). Changes in the peak values for the lat- 
est 256 samples are observed (s105). Estimation of a 
vertical change regarded as a rhythm observes whether 
an interval regarded as a tempo (the least rhythm) of 15 
general music periodically appears as a vertical 
change, whereby a tempo regarded to be closest is esti- 
mated as a tempo which a piece of music being played 
has (s106). 

[0081] Fig. 35 shows another example of the level 20 
change of a piece of music in the music CD, in which 
each solid line having arrows indicates a peak change 
interval predicted as a tempo of general music, and 
each dot line having arrows indicates a peak change 
interval that is not regarded as a tempo. 25 
[0082] In the case where a multiple of the tempo (the 
least rhythm) in the music, for example, a four-fold 
(quadruple) rhythm is used as a timing for performing 
key operations on dance commands, it is impossible to 
specify which of the extracted tempos as the starting 30 
point (the start of a measure of the music) of the quad- 
ruple rhythm. Thus, without performing processing, the 
timing acquisition described using Fig. 17 can be only 
performed. 

[0083] Accordingly, the flow of a program for specify- 35 
ing the start of the measure of the music based on an 
input by the player is shown in Fig. 36. Specifically, 
when an input (key operation) by the player is detected 
(s111), the input timing is compared with the timing of 
the extracted tempo, whereby the timing of the closest 40 
tempo is determined to be quadruple (the starting point 
of the rhythm) (s1 12, s1 1 3), and the timing is used as a 
starting point to estimate a time up to the next quadru- 
ple time (s114). This performs the timing acquisition. 
[0084] Also in the case where the rhythm of the music 45 
extracted from the music CD differs from the rhythm of 
the prepared music, there may be no motion data of a 
dance corresponding to the frame to be displayed. The 
flow of a program for interpolating the dance motion in 
time with the rhythm is shown in Fig. 37. so 
[0085] Initially, the number of frames to be displayed 
(how many frames constitute the actual motion) is found 
(s121). The program finds the number of frames to 
which the interval of the music being played corre- 
sponds (s1 22). From these values, the frame number of 55 
the dance motion to be displayed, which corresponds to 
the desired frame number for display, is found (s123). 
Specifically, for example, in the case where the dance 



motion to be displayed consists of 60 frames per 
rhythm, and the rhythm interval of the music being 
played is 45 frames, when the 1 0th frame is the desired 
frame, the (60/45 ( 10 = 13.33...)-th frame is displayed. 
[0086] It is determined whether there are motion data 
corresponding to the frame number found in step S123 
(Specifically; whether the found frame number includes 
places of decimals) (s124). If there are (no places of 
decimals are included), the corresponding motion data 
are sent to the image processor (s125). 
[0087] If there are not (places of decimals are 
included), among the existing motion data, data of adja- 
cent frame numbers (the 13th frame and the 14th 
frame) to the frame closest to the found frame are used 
to generate motion data corresponding to the frame 
number found by interpolation (s126), and the gener- 
ated data are sent to the image processor. 
[0088] The above-described processes are performed 
between steps S46 and s47 described using Fig. 17. 
[0089] In addition, by using a device with a vibrator 
(generator) unit as a controller, vibration is generated in 
key-operation timing for command inputting or when 
command inputting fails, whereby an instruction and 
warning can be given to the player. 
[0090] Fig. 38 shows the structure of the control sys- 
tem of a vibration unit, which includes a music-vibration- 
command generator 710, a motion-vibration-command 
generator 720, a system-status-vibration-command 
generator 730, and a main vibrator unit 740. 
[0091] The music-vibration-command generator 710 
includes a music-playing-position measuring means 
711, a vibration sequence table 712 describing what 
type of vibration should be generated in what position of 
the music, a music-vibration generating means 713 for 
generating, based on the playing position measured by 
the music-playing-position measuring means 711, 
vibration-control information at the present time from 
the vibration sequence table 712, and a vibrational- 
strength/apparatus/method determining means 714, 
and generates vibration commands corresponding to 
playing positions of the music, such as key-operation 
timing for command inputting. 

[0092] The motion-vibration-command generator 720 
includes a motion measuring means 721 for measuring 
the progress of the motion, a motion-vibration sequence 
table 722 describing what type of vibration should be 
generated in what position of the motion, a motion vibra- 
tion generating means 723 for generating, based on the 
progress measured by the motion measuring means 
721, vibration control information at the present time, 
and a vibrational-strength/apparatus/method determin- 
ing means 724, and generates vibration commands cor- 
responding to the progress of the motion. 
[0093] The system-status-vibration-command gener- 
ator 730 includes a system-status acquisition means 
731 for acquiring information the status of the system, a 
system-status vibration generating means 732 for vibra- 
tion control information from the information acquired by 
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the system-status acquisition means 731, and a vibra- 
tional-strength/apparatus/method determining means 
733T for generating vibration commands from the vibra- 
tion control information. The system-status-vibration- 
command generator 730 generates vibration generates 
vibration commands according to system status such as 
failure in command inputting. 

[0094] The main vibrator unit 740 includes a vibrator- 
driving program 741 holding a future program for driving 
the vibrator, a vibrator-driving command-synthesizing 
means 742 that performs the steps of receiving vibra- 
tion commands from the vibration-command generators 
710 to 730 t comparing the received commands in 
strength and time with vibration conditions (vibration 
information at the present time and future vibration pro- 
gram), and updating the contents of the vibrator-driving 
program 741 as required, a vibrator-driving control 
means 743 for controlling, based on the contents of the 
vibrator-driving program 741, the driving of the vibrator 
in consideration of types and characteristics of usable 
vibrator, power consumption and usable capacity, and 
psychological effects of vibration, etc., and a vibrator 
744 provided in the controller 2, the driving of which is 
controlled by the vibrator-driving control means 743. 
[0095] Fig. 39(a) shows the flow of a program of a 
music vibration command generating process, Fig. 
39(b) shows the flow of a program of a vibration com- 
mand synthesizing process, and Fig. 39(c) shows the 
flow of a program of a vibrator-driving control process. 
[0096] The case where the present invention is 
applied to a home game machine has been described, 
but it is clear that the present invention can be applied to 
commercial game machines, etc., installed in game 
amusement arcades and amusement facilities. 

Claims 

1 . A method for controlling a video game designed so 
that a player determines the behavior of a character 
on a video screen, and the behavior itself, or effects 
caused by the behavior, or both are displayed on 
the video screen so as to be enjoyed, said method 
characterized in that a dance performed in time with 
music is used as a behavioral factor determined by 
said player, and an evaluation of the dance is pre- 
sented to said player. 

2. A method for controlling a video game according to 
Claim 1 , wherein the progress of the game is con- 
trolled in accordance with the evaluation of said 
dance. 

3. A method for controlling a video game according to 
Claim 1 or 2, wherein said dance comprises a com- 
bination of short dances (actions) of a plurality of 
types. 

4. A method for controlling a video game according to 



Claim 3, wherein one action is executed when a 
predetermined dance command is input. 

5. A method for controlling a video game according to 
5 Claim 4, wherein predetermined-dance-command 

inputting is performed with a controller having keys 
of a plurality of types by operating the same or dif- 
ferent type of keys twice or more times in predeter- 
mined order, simultaneously operating at least two 
10 types of keys, operating the same key for not less 
than predetermined time, or arbitrarily combining 
these operations. 

6. A method for controlling a video game according to 
15 Claim 4, wherein, when one predetermined dance 

command is input, it is determined based on char- 
acter condition that said predetermined dance com- 
mand is not input, and no action is executed. 

20 7. A method for controlling a video game according to 
Claim 6 t wherein the character condition comprises 
the condition of said character that time and the 
motion of said character. 

25 8. A method for controlling a video game according to 
any one of Claims 4 to 7, wherein the evaluation of 
said dance is performed by determining whether or 
not dance-command inputting is in time with the 
rhythm of music. 

30 

9. A method for controlling a video game according to 
Claim 8, wherein the evaluation of said dance is 
performed such that, as the difference between tim- 
ing of dance-command formation and the accent of 

35 the rhythm of the music is lesser, a higher score is 
given. 

10. A method for controlling a video game according to 
Claim 8 or 9, wherein the evaluation of said dance 

40 is performed such that a score is reduced when 
command inputting fails, and command inputting is 
not performed for predetermined time or more. 

11. A method for controlling a video game according to 
45 any one of Claims 8 to 10, wherein the evaluation of 

said dance is performed such that an additional 
score is given when the inputting of a command 
having a high level of difficulty succeeds, succes- 
sive actions succeed, a composite action is per- 
so formed, no failure in command inputting is detected 
for not less than predetermined time, and the con- 
nection between actions is preferable. 

12. A method for controlling a video game according to 
55 any one of Claims 1 to 1 1 , wherein arbitrary music 

other than music prepared as dance music is used. 

13. A method for controlling a video game according to 
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any one of Claims 1 to 12, wherein a camera per- 
spective position, light adjustment, etc., as to dance 
performed just before the present dance, or stored 
dance, are edited and stored. 

5 

14. A method for controlling a video game according to 
any one of Claims 1 to 1 3 t wherein a character dis- 
played using 3-D polygons is used for said charac- 
ter. 

10 

15. A video game machine provided with means for 
determining by a player the behavior of a character 
on a video screen, and means for displaying on the 
video screen the behavior itself, effects caused by 

the behavior, or both, 15 

said video game machine further including: 
character-display control means for dancing 
said character in accordance with operation by 
said player; and 20 
evaluation means for evaluating the dance of 
said character. 



16. A video game machine according to Claim 15, fur- 
ther including means for controlling the progress of 25 
a game in accordance with the evaluation of the 
dance. 

1 7. A video game machine according to Claim 15 or 1 6, 
further including means for executing one action 30 
constituting the dance when a predetermined 
dance command is input. 

18. A video game machine according to Claim 17, fur- 
ther including means in which, when on a controller 35 
having keys of a plurality of types, the same or dif- 
ferent type of keys are operated twice or more times 

in predetermined order, at least two types of keys 
are simultaneously operated, the same key being 
operated for not less than predetermined time, or 40 
these operations are arbitrarily combined, said 
means determining that said predetermined com- 
mand has been input. 

19. A video game machine according to Claim 17, fur- 45 
ther including means in which, when one predeter- 
mined dance command is input, said means 
determines based on character condition that said 
one predetermined dance command is not input, 
and executes no action. 50 

20. A video game machine according to any one of 
Claims 15 to 19, further including means for evalu- 
ating said dance based on whether or not dance- 
command inputting is in time with the rhythm of 55 
music. 

21. A video game machine according to Claim 20, fur- 



ther including means in which, as the difference 
between timing of dance-command formation and 
the accent of the rhythm of said music is lesser, 
said means gives a higher score. 

22. A video game machine according to Claim 20 or 21 , 
further including means for performing score reduc- 
tion when command inputting fails, and no com- 
mand is input for not less than predetermined time. 

23. A video game machine according to any one of 
Claims 20 to 22, further including means in which, 
when the inputting of a command having a high 
level of difficulty succeeds, successive actions suc- 
ceed, a composite action is performed, no failure in 
command inputting is detected for not less than 
predetermined time, and the connection between 
actions is preferable, said means gives an addi- 
tional score. 

24. A video game machine according to any one of 
Claims 15 to 23, further including means for using 
arbitrary music other than music prepared as dance 
music. 

25. A video game machine according to any one of 
Claims 15 to 24, further including means for editing 
and storing a camera perspective position, light 
adjustment, etc., as to dance performed just before 
dance at present, or stored dance. 

26. A video game machine according to any one of 
Claims 15 to 25, further including display-control 
means for controlling a character displayed using 3- 
D polygons. 

27. A medium in which is recorded the program of a 
video game designed so that a player determines 
the behavior of a character on a video screen, and 
the behavior itself, or effects caused by the behav- 
ior, or both are displayed on the video screen so as 
to be enjoyed, said medium characterized in that a 
dance performed in time with music is used as a 
behavioral factor determined by said player, and an 
evaluation of the dance is presented to said player. 

28. A medium according to Claim 27, wherein the 
progress of the game is controlled in accordance 
with the evaluation of said dance. 

29. A method for controlling a video game according to 
Claim 12, wherein when a multiple rhythm of the 
least rhythm in the music is used as a timing for per- 
forming key operation on the dance command, 
rhythms are extracted from said arbitrary music, 
and among the extracted rhythms, the timing of the 
rhythm closest to the timing of the key operation by 
said player is set as the starting point of said multi- 
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pie rhythm. 

30. A method for controlling. a video game according to 
Claim 12 or 29, wherein when the rhythms of said 
arbitrary music differ from the rhythms of the pre- 5 
pared music, and motion data of a frame to be dis- 
played are not found, interpolation data are 
generated from motion data of the adjacent frames, 
and are displayed. 

10 

31. A method for controlling a video game according to 
any one of Claims 5 to 15, or Claim 29 or 30, 
wherein a controller with a vibrator is used to gener- 
ate vibrations when timing inputting for key opera- 
tion for command inputting, or command inputting, 15 
fails. 
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